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Abstract 

In  general,  problems  tr«  solvable  along  a  continuum  of  ab¬ 
straction.  Thar*  Is,  at  any  given  point  In  the  development  of 
the  solution,  a  Most  efficient  or  optimum  strategy. 

In  information  retrieval  system*  the  ultimate  solution  is 
obtained  at  a  acre  specific  rather  than  at  a  acre  abstract  level. 
The  question  negotiation  process  is  viewed  as  an  affiolent  pre¬ 
liminary  strategy  which  enables  sn  infomation  seeker  to  obtain 
his  infomation  goal  with  the  least  aaount  of  overall  effort. 

In  order  for  a  problem  solution  procedure  to  remain  efficient 
a  naans  for  predicting  when  to  change  strategies  met  be  provided. 
In  the  particular  example  of  question  negotiation,  this  prediction 
Is  based  on  the  rate  at  which  tha  definition  of  the  user's  nsed 
develops. 

An  on-line  computer  program  o tiled  ClfilNS  is  described  which 
iaplesMnts  the  Infomation  specialist's  role  In  the  negotiating  of 
a  user's  need.  This  program  communicates  with  the  ussr  in  his 
natural  conversational  idiom.  When  tha  negotiation  la  judged  by 
OSINS  to  be  aa  well  developed  as  It  Is  likely  to  get,  a  search  is 
made  of  the  available  documents.  This  search  produces  an  ordered 
list  of  the  sixty-three  best  documents  which  oosm  close  to  the 
user's  expressed  need. 

The  structure  of  the  program  is  modular  so  that  improvements 
any  be  easily  mads.  Some  such  laprcv—mats  are  suggested. 


ihi*  »n  uuonMvion  nm  5h»  Ui*  prubli***  o? 
defining  hit  need  and  of  locating  information  mources  which  arm  ablm  to 
satisfy  the  n*md.  These  problems  require  a  strategy  for  thmlr  solution. 

PmM  ■■  solutions  Jnt  gnwml  £jm  aKI*^  war!  af.  wl  m  1  atal  m 

along  a  continuum  of  abstraction.  One  may  find  solutions  from  thm 
■pacific  to  th*  g •rival. 

Each  suoh  solution  la  obtained  on  thm  basis  of  a  strategy  which  la 
oharaotarlxmd  by  thm  toola  and  techniques  available  at  *he  particular 
lmvml.  Thm  lower  levels  tend  to  harm  behavioristic  or  pragmatic  tech¬ 
niques  associated  with  thma  whilm  thm  higher  levels  more  often  have 
generalisations  which  act  to  make  transformations  between  various 
samples  found  at  the  lower  levels. 

The  formation  of  a  plan,  followed  by  its  execution,  is  an  example 
of  a  multi-level  approach.  In  mffeot  therm  arm  two  solutions.  Thm  plan 
formation  offers  a  means  of  vicariously  perforating  the  execution  of  a 
task  using  symbolic  techniques  before  the  plan  is  actually  employed. 

The  work  at  the  abstract  level  has  as  its  chief  advantage  t  say  oral  and 
spatial  mobility  at  low  cost.  The  abstract  solution  is  relatively  un¬ 
encumbered  by  physical  restrictions  of  time  is nd  space.  There  ia  the 
constant  risk  at  the  abstract  level  of  error.  The  symbols  may  prove 
to  be  inappropriate.  The  resultant  solution  of  the  abstract  problem 
is  therefore  an  eetimats  of  solutions  to  be  obtained  at  the  lower  levels. 

For  a  given  researcher  with  a  giT«n  set  of  capabilities  at  his 
disposal  there  is  an  optimum  strategy  for  each  aspect  of  Oiat over  pro¬ 
blem  lime  before  him.  Optimal  here  means  that  adequate  reeulte  ere 
obtained  for  the  least  expense  (time,  money  or  intellectual) .  The 
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onoe  <  >ti*ua  strategy  will  rest h  a  point  i*iere  it  cannot  of fsr  much  mors, 
wbsre  it  becomes  axpsnsivs,  and  where  some  other  strategy  riser  to  the 
position  of  being  the  optimum  (if  only  by  default). 

How  can  in  existing  strategy  b»  analyzed  for  its  appropriateness? 
Every  strategy  has  iti  rate  of  return  on  increment  of  investment.  If 
the  investment  increment  ic  cone  tint  for  a  given  strategy,  the  beet  ab¬ 
solute  measure  of  the  quality  of  the  strategy  ie  ite  rets  of  return* 

When  thi*  rate  of  return  drops  to  mm  minimum  level  we  may  define  this 
point  ie  in  operitionil  Unit  of  the  effectiveneee  of  the  etretegy.  Of 
oouree  this  does  not  tell  us  if  iny  altemitlvs  strategies  ere  is  good 
or  better  thin  the  existing  strategy.  A  dilsem  results  because  we  will 
not  really  know  whi'  h  strategy  ie  beet  until  we  Lry  each  such  alternative 
■trategy.  The  dilemma  ie  resolved  (or  at  least  smoothed  over)  by  re¬ 
treating  to  a  Meta-strat ear  with  the  problem  of  strategy  selection.  The 
solution  obtained  from  the  meta-etrategy  is  a  prediction  (presumably 
based  on  prior  experience)  of  which  new  strategy  to  adopt. 

Inforaation  retrieval  processes  in  a  library  syetem  nay  be  viewed 
as  a  form  of  ths  problem  solution  process  with  Multiple  strategies 
existing  along  a  continuum  of  specificity. 

The  retrieval  of  information  requires  the  selection  of  search 
strategies  which  operate  along  this  oontlnuua.  Ths  actual  material  that 
contains  the  needed  information  will  ba  specific,  whereas  the  title,  ab¬ 
stract,  indices,  and  other  referential  means  are  More  abstract.  Beyond 
these  are  the  even  less  specific  reference  services  which  rely  on  the 
highly  a be tract  technique*  of  human  discourse. 

When  a  user  approaches  an  inforaation  retrieval  system  he  Mist 
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travel  from  the  more  abstract  levels  to  the  specific  levels  If  he  is  to 
utilize  the  system.  The  ignite*  include*  the  mean*  of  locating  the  meet 
appropriate  materials  and  if  a  user  attempts  to  go  directly  to  a  specific 
material,  he  is  attempting  to  bypass  the  syetesi.  As  has  been  pointed  out 
previously  (i,2  },  a  user  will  often  approach  the  reference  disk  in  a 
library  with  too  specific  a  request  for  his  information  needs.  This  re¬ 
quest  must  be  negotiated  to  a  higher  level  so  that  the  reference  librar¬ 
ian  can  present  to  the  user  the  beat  ec^rosdse  between  what  the  user 
needs  and  what  the  library  hae  to  effar. 

The  user's  information  need,  however  ill -defined,  first  suet  be  at 
least  crudely  defined  within  the  user's  epaoe  of  idaas.  This  apace  ia 
r imply  a  convenient  way  of  characterising  the  user's  private  system  of 
coherent  (to  himself)  thought.  In  order  to  make  a  definition  within 
this  space  it  is  neoessaxy  to  gat  a  "fix"  within  the  apace  as  a  navi¬ 
gator  does*  While  this  navigator  may  use  whatever  stars  end  lighthouses 
that  may  happen  to  be  available,  he  will  prefer  to  use  those  that  are 
orthogonal  with  respect  to  one  another*  Likewise,  in  older  to  define 
the  location  of  an  Idea  within  a  space  of  ideas  it  ia  daairabls  to 
utilisa  orthogonal  coordinates  for  the  purpose.  The  coordinates  here 
may  be  thought  of  as  the  residuals  of  past  experience  which  have  been 
reduced  to  symbolic  representations  of  those  experiences.  By  mesne  of 
this  cross-refersncing  the  ambiguity  may  be  reduced. 

The  goal  of  a  question  negotiation  process  is  to  reach  an  adequate 
definition  of  the  need,  first  with  respeet  to  the  user's  space  of  ideas 
end  then  with  respect  tc  the  Information  retrieval  system's  "space  of 
Ideas".  The  retrieval  system's  "space  of  Ideas"  may  be  represented  by 
the  eyetea's  mean* 


of  indexing. 


I 

5 

It  is  desirable  to  make  that*  twr  steps  in  a*  efficient  a  Mannar  as 
possible  in  ordsr  that  the  rafarsnos  service  will  net  become  too  oostly 
to  the  user, 

j  The  efficiency  of  the  first  step  is  largely  a  function  of  the  skill 

of  the  reference  librarian  as  a  question  negotiator,  Hot  only  Must  the 
user  be  eet  et  ease,  he  met  also  be  stimulated  along  those  lines  that 
will  lead  to  a  satisfactory  definition  of  hie  need. 

By  s  skillful  selection  of  negotiation  strategies  at  the  com  era*- 
tionsl  level,  the  refers nee  librarian  attempt#  to  elicit  fro*  the  user 
sufficient  Information  to  get  a  satisfactory  picture  of  hie  need.  In 
this  role  the  librarian  acts  as  the  navigator  attempting  to  establish 
orthogonal  bearings  wttLoh  era  transformable  onto  the  librarian's  chart 
(index  system).  The  measures  that  the  librarian  obtains  will  not  be 

* 

reliable  until  they  produce  Internally  consistent  results.  The  librarian 
will  attempt  to  develop  as  many  Independent  lines  of  approach  as  era 
necessary  to  obtain  such  consistency.  The  user  nay  be  asked  what  ha 
needs  the  information  for,  how  certain  as pests  of  his  question  are  re¬ 
lated,  and  so  forth. 

The  treneformtion  of  the  defined  need  into  the  retrieval  system's 
space  is  essentially  a  problem  of  interpretation*  The  user's  expression 
of  his  need  may  not  be  adequately  understood  fay  the  librarian  (acting  as 
a  part  of  the  information  system),  The  communication  channel  may  be 
faulty  either  due  to  noise  or  to  a  disparity  of  idioms  between  the  user 
and  the  librarian.  If  the  idioms  have  an  insufficient  comeon  basis  the 
,  conversation  must  be  conducted  at  a  more  general  iegulctle  level  which 

la  ccomon  to  both  user  msA  librarian  and/or  the  services  of  an  inter- 
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asdiary  translator  sost  be  used.  In  brief  ,  l Z  V.  -  user' s  prof essienai 
Jargon  ic  beyono  tha  understanding  of  ttaa  librarian,  eons body  will  have 
to  explain  it  to  hlM, 

Qirm  that  tha  librarian  it  abla  to  onrf#r#i*nd  tha  user's  quest  Ion. 
it  la  additionally  neoassary  that  tha  question  bs  defined  with  respect 
to  the  Infoxvatlnn  retrieval  cyeten. 

Ihe  two  definitions  of  the  user's  need  {hit  own  and  the  system* •) 
do  not  have  to  be  aade  Independently.  Aaeuaing  that  tha  user  approaches 
the  retrieval  syaten  with  an  lneufficiently  defined  need,  both  defini¬ 
tion*  nay  be  derived  by  the  sane  Interactive  process.  In  this  way  the 
eysten  can  help  the  user  by  concentrating  on  those  coordinates  which 
are  represented  in  both  spaces  (or  nearly  so). 

lha  Iterative  process  of  defining  the  user's  need  should  be  per¬ 
missive.  The  librarian  should  not  attempt  to  force  the  user  to  make  or 
reject  an y  definition.  This  holds  even  for  definitions  previously  sug¬ 
gested  by  the  user.  Any  ouch  attempts  may  thwart  the  free  flow  of  Ideas 
earning  fro*  the  user  end  hence  restrict  the  development  of  the  most 
satisfactory  definition  to  the  u*  The  user  should  be  permitted  to 
express  e  change  of  mind  such  that  he  earn  steer  the  librarian  towards 
hie  need.  This  change  may  be  a  shift  in  subject  arc*,  in  emphasis,  or 
in  scope.  This  is  to  say  that  tha  negotiation  ia  not  viewed  here  as  a 
hierarchical  procedure  of  simply  narrowing  down  the  space  of  definition. 
Rather,  the  process  is  seen  a a  the  Identification  aul  devalopnact  of 
relevant  dimensions  of  thought  without  regard  to  any  hierarchical 
structure.  Figure  1.  illustrates,  ia  a  two  dimensional  space,  the 
changing  scope  and  locus  of  a  user's  hypothetical  expression  of  his 
need  as  the  negotiation  develops. 
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Alternatively,  the  movetasnt  of  the  user's  Interest  ss  sapped  onto  s 
hypothetical  Ura  coordinate  index  specs  is  illustrated  in  flours  2. 

notice  that  toward  the  end  of  the  negotiation  the  user's  expressed  need 
tends  to  settle  In  one  neighborhood  end  ss  *  result,  the  distance  that  the 
user's  expressed  need  shifts  on  each  successive  interaction  crows  shorter. 

A  negotiation  ie  considered  useful  until  it  reaches  a  point  of 
dsrelopaent  share  further  effort  bscsmea  uneconomical*  That  is,  the 
negotiation  is  continued  until  little  acre  definition  of,  or  change  in 
the  user's  need,  is  anticipated. 

The  rate  of  change  in  the  definition  of  the  user's  need  may  be  used 
to  determine  when  the  conversational  strategy  should  be  replaced  by  the 
search  strategy*  In  this  Banner  we  have  a  formal  means  of  conducting  a 
(near)  optimum  negotiation  of  the  user's  information  need* 


Flftfa  2»  Jha  OhAociL'c  Imu  of  *  Hypothatieal  Search 

Spaatfiaatlt*  la  a  Thraa  Tana  OoordlnaU  Space 
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In  order  to  implement  systematically  the  interpretation  of  the 
negotiation  of  a  user’s  need  aa  aet  forth  in  the  first  chapter  of  thle 
thesis,  aereral  requireaNaite  should  bs  cor.sidsrsd . 

Slnee  the  implementation  is  done  by  aaane  of  a  Mechanical  device, 
oertain  reetriotione  are  imposed  on  the  dialogue  that  take#  place  be¬ 
tween  the  uasr  and  the  device.  Cotmati  cation  will  be  reetrloted  in  both 
directions  to  forma  that  are  machine  gen  arable  and  Machine  analyaable. 

Thle  means  that  extra-linguiatio  forme  of  communication  euoh  as  facial 
expression,  tone  of  voice,  and  the  like  are  not  utilised.  It  would  be 
convenient  to  Imagine  a  user  and  a  remotely  situated  reference  librarian 
whose  only  Beene  of  ooamunieatlcn  are  teletype  Machines.  This  restriction 
alone  imposes  e  burden  on  the  user,  who  must  use  a  secondary  oocesunl cation 
Modality  In  order  to  ooummleat*.  The  user  may  be  a  poor  speller  or 
typist  or  both. 

The  pace  of  the  dialogue  Bust  be  necessarily  a  bit  slower  then  a 
▼seal  dialogue  because  of  the  physical  (not  to  nmntion  the  human)  limita¬ 
tions  on  speed  of  character  trensadealon.  Furthermore,  eech  party  suet 
wait  hie  turn,  as  interrupt! yns  are  not  generally  permitted . 

The  ultimate  test  of  an  information  retrieval  procedure  la  the  ex¬ 
tent  to  which  It  is  used  (after  the  novelty  period  wears  off) .  This 
means  that  it  aust  become  more  useful  than  competing,  preexisting  pro¬ 
cedures.  Its  yield  on  user  investment  of  time,  effort,  and  money  must 
be  more  favorable  than  other  means. 

In  order  to  aoooaplish  this  the  user  must  be  met,  as  far  as  possible, 
on  his  own  terms.  If  it  were  possible  to  "read*  the  ue«r<s  mind  by  mm 
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advanoad  ISO  or  other  technique.  than  this  would  be  desirable  since  it 
would  reduce  the  uaar's  oonsunloation  effort,  however,  for  the  present 
at  least  ho  it  required  to  typo  out  hio  responses, 

Zt  is  necessary  to  place  the  user  at  hi*  in  hio  connunlcation  with 
the  reference  librarian.  Tho  uoor  is  not  to  bo  distracted  from  his  ef- 
forts  in  defining  this  information  nood.  Tho  confusion  of  a  novice 
on  taring  a  lyitta  is  especially  dangerous  hors,  A  heavy  usage  of  special 
formats  and/or  oodoo  io  to  bo  avoided  for  thie  reason* 

In  brief,  the  user  is  to  be  permitted  to  use  his  no  ml  conversa¬ 
tional  idioH.  The  require*  on  to  of  the  Queen*  t  Bngllsh  (whatever  they 
are)  are  considered  to  be  too  restrictive  for  these  purposes. 

A  aeane  for  analysing  user  responses  Bust  therefore  be  provided 
which  will  be  quick.  Bake  few  errors,  and  which  has  great  tolerance  of 
typographical  and  spelling  errors  and  of  grsBBetlosl  variations,) 

Tht  seans  by  which  the  eye  tea  provides  feedback  and  stiaulstlon  to 
the  user  Bust  be  sufficiently  flexible  to  allow  for  a  wide  variety  of 
outputs.  The  general  pattern  of  these  outputs  should  at  least  appear 
to  be  relevant  to  the  particular  negotiation  in  progress. 

Without  the  appearance  of  interest  fron  the  aye  tan,  the  user  nay 
quickly  feel  as  though  he  is  talking  to  hi— alf  alone  (which  is  really 
what  he  is  doing) .  Without  the  sense  of  an  audience,  the  user  nay  lose 
interest  In  hie  own  talk  and  attempt  to  end  the  negotiation  process  pra¬ 
na  turely. 

In  addition  to  the  conversational  capabilities  a  data  base  is 
necessary  if  a  negotiation  of  the  user’s  need  is  to  be  aaeningful.  This 
data  bass  —*t  be  representable  in  an  n-di— —lo— 1  coordinate  space  so 
that  the  usar'e  expressed  need  nay  be  Mpped  into  it* 
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A  coordinate  indexed  collection  of  about  twenty-eix  hundred  doetwente 
la  Maintained  at  tha  C«k*  for  tha  Inforwetioo  Sciences  (3).  The  doou* 
■ante  are  indexed  with  terse  *roa  a  Hat  of  about  440  ltens. 

Serial  and  inrerted  filea  are  presently  maintain  ad  for  axperlnantal 
and  reference  purposes*  A  eceputsr  search  of  tbeae  file*  la  presently 
luplenantsd  by  Beane  of  a  forual  aeareh  ec— and  which  Bay  include  op  to 
four  mafcers  ( representing  Index  terse)  which  are  conbined- with  the  logle 
operators  "and",  "not"  and  "or". 

The  fornallty  of  the  present  procedure  la  awkward  for  a  potential 
user  baoauaai  1)  ha  aay  not  be  able  to  fraaa  adequately  hie  need  in  tha 
praoisa  fomality  required  by  the  aystaaj  2)  he  nay  not  be  sufflelently 
feel  liar  with  the  Index  term*  used  to  Index  tha  collection;  3)  hie  need 
■ay  require  Bore  then  four  tame  with  differing  degrees  of  emphasis  on 
different  terse j  and  k)  he  nay  not  hare  an  g  priori  feel  for  the  contents 
of  the  collection  itself. 

An  interface  la  therefore  desirable  for  this  collection  whereby  a 
user  can  internet  with  the  qyeten  on  bis  own  tame.  Thus  an  lnplananta- 
tlcn  of  a  Beans  to  negotiate  the  user’s  need  would  serve  the  purposes  of 
both  the  0  I  S  collection  and  this  thesis. 


iu.  gaga,  a  Jfesani 

A  oonputer  pro  (rut  Has  been  developed*  Id  order  to  provide  *  dynanio 
basis  with  which  i  1)  to  •  inula  te  the  role  of  tho  reference  librarian  la 
negotiating  a  user's  Information  used]  2)  for  patterning  aora  affloloat 
negotiation  strategical  and,  3)  to  act  aa  a  working  latarfaea  to  tha 
experimental  rafarasea  retrieval  system  at  tha  Center  for  tha  Information 
Sciences  at  Lahlgh  University** . 

this  program,  called  QfiXMS  67  (for  General  Batriaral-Inquiry 
Negotiation  Structure,  1967) ,  la  written  Mini?  In  FORTRAN  U,  with 
coaa  detaile  written  In  VFAP,  (Valle?  forge  Assembly  Program).  OSINS 
was  tailored  specifically  for  on-line  aooaaa  using  a  teletype  ooncole 
and  tha  computing  faeilltiea  are! Table  at  tha  Lehigh  University  Computing 
Center  whloh  include  an  tt  oora  aeerii'j  OS-225  computer  with  four  eagnetlo 
tape  handlers,  a  dice  storage  unit  and  a  Oatanet-15  data  transadsslon 
oootrollar  (for  resnte  aooaas  to  the  oooqnter),  as  well  as  other  peri¬ 
pheral  Input-output  equipment.  Copies  of  tha  0  2  3  system  serial  (doeu- 
■ant)  and  inverted  (index  tern)  files  are  Maintained  as  a  pemanent  store 
on  disc.  In  addition  a  ’publio'  area  Is  available  for  temporary  storage 
on  dlso* 

Because  the  oore  memory  in  this  Installation  la  severely  United, 
the  progren  was  written  as  a  series  of  tan  links,  chained  together  on 
aacietlo  tape.  The  links,  which  are  ejgtauiabl*  to  a  total  of  63,  are 

#  Program  listings  are  too  lengthy  for  inclusion  in  this  report. 

They  will  too  available  free  the  author's  files  far  a  period  of  five 
years. 
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Modularised  Into  funotionel  units  u  shown  In  Figure  3.  This  Modular¬ 
isation  will  p«ralt  later  modifications  to  bo  nad*  for  the  l*|**ov«eent 
of  GHDiS  u  working  experience  end  •cqp#rl»mUUon  dictate. 

The  chaining  procedure  !•  euoh  that  any  link  oan  ba  replaoed  In  oora 
by  any  other  link*  The  oaenon  data  area  la  left  unaffected  eo  that  data 
atcrad  by  one  link  aay  be  used  by  tea  following  links.  The  following 
link  la  daalgnatad  by  the  link  currently  in  oora  Meaoxy.  The  ton  links 
used  in  OBDia  are  briefly  staaeerised  In  figure  4, 

These  links  nay  also  ba  oonvenl«itly  grouped  aa  follows  1 


Conversation 

laker 

Listen 

Cheek 

Connectivity 

Aoooat 

Decision 

Search 

Duap 

Housekeeping 

Inlt 

Found 

Terain 

How 

In  addition  to  the  permanent  dleo  files  Mention ed  above*  several 
other  files  are  uaad  apaolf loally  by  ^BBiS  and  are  transferred  tram 
nagnetio  taps  to  tea  disc  by  Inlt  at  the  start  of  tha  program* 

These  files  Inolade  a  list  of  referent  tarns,  a  list  of  basic  re¬ 
sponses  that  GBXHS  oan  asks,  a  user  information  fils  and  a  control  vaotor* 
laoh  of  these  files  are  explained  In  aore  detail  below. 

Several  us  ere  nay  vish  to  use  QB3NS  at  tha  sane  tine.  While  on# 
user  is  negotiating  hie  request  another  nay  be  scanning  boss  Materials 
previously  suggested  to  hi*  by  tee  ajeten* 

With  WM  the  in  terse tion  proeeee  need  not  bo  restricted  to  a 
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Print  0BXM3*  sentences 

3 

3 

Li* tan 

Analyte  user's  response 

4,9 

4 

Cheok 

Chaok  analysis  of  raaponaa 

Control  course  of  oomrsraatlon 

2, 5, 6,7,® 

5 

AaoMt 

Combine  results  of  this  and 
previous  raspottsaa 

Tast  oocrr  creation  for  stationer!  ty 

2,6 

6 

Searoh 

Font  weigh tad-rank  ordered  list  of 
docuMnte 

7 

7 

Duap 

Present  ion  doeuasnt  titles  to  user 

2 

8 

Termln 

9*7  good by,  prepare  for  next  user 
or  terminate  program 

i,mT 

9 

Mow 

Speolal  link  for  modifying  oontrol 
▼so tor 

any  link 

10 

^ - .a 

rwflu 

Kxtantlon  of  Inlt  for  previous 

ttsare 
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Figure  4. 

Fractions  of  OHMS  links 
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single  conversation.  A  user  nay  return  n  usny  tl jms  u  he  wishes,  to 
oontimie  hia  searching.  features  of  his  previou*  conversations  oan  bo 
saved  for  hia  in  •  user  fllo  oot  aside  for  tho  purpose, 

a.  MkUak 

Tho  Inlt  link  is  always  tho  first  link  to  bo  called  in  QKDJS,  Tho 
currant  dots  Is  typed  cut  on  tho  teletype  to  domaant  tho  oonrsrestlon, 
followed  by  a  greeting  «ni  o  request  for  the  user's  none.  If  this  is 
the  start  of  tho  program,  tho  files  Motioned  shore  will  bo  transferred 
froa  Magnetic  tape  to  dieo,  and  a  notice  that  this  is  happening  is  pre¬ 
sented  to  tho  user. 

Begsrdlooo  of  whether  this  is  tho  first  or  a  later  call  to  Inlt. 
the  user's  last  nano  is  eheoked  against  a  user  list  of  un  to  thirty-two 
nanos.  If  tho  naao  appears  on  this  list  ths  Found  link  is  limed  lately 
called  to  replace  Inlt. 

If  tho  nans  is  not  located,  the  user  will  be  told  that  his  nano  is 
not  familiar ,  He  is  then  asked  if  he  has  used  the  eyotea  before.  If 
the  user  answers  "yes",  hie  nano  is  reeheoksd.  If  the  non  ie  still 
unfamiliar  to  the  eye  ten  the  user  ie  asksdt 

WHAT  DO  1DU  HAUT#  MB. _ ? 

The  earn  title  is  ussd  for  all  user's  because  of  ths  lack  of  any 
staple  nsthod  of  inferring  tbs  user's  seat,  narltal  status  or  professional 
title. 

The  Listen  link  is  then  called  so  that  GBDtt  ean  receive  the  user'o 
first  conversational  response. 

The  idmtifieation  prooedu re  used  h«e  is  mhryimlo  sal  is  currently 
justified  only  on  ths  basis  tbet  ths  use  of  an  Individual's  none  tends 
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to  add  a  paraonal  touch  to  hla  relationship  vl«h  tha  system. 

At  eon*  law  data  a  brief  set  of  operatic  instructions  may  be  In¬ 
cluded  hare  for  thoaa  who  may  require  it.  In  addition,  the  identification 
prooadure  can  ba  elaborated  upon  if  neoeisery  for  security  purpoeee, 

it  the  present  time  if  two  users  have  the  aeue  last  acne,  one  or  doth 
of  then  nost  adopt  a  pseudonym  If  they  ere  to  be  diatirguiehed,  Ibis  ia 
particularly  pertinent  If  a  user  wishes  to  piok  up  hie  interaction  there 
he  left  off  at  acne  previous  tiaw. 

B,  Found  link 

The  Found  link  ia  called  only  share  a  user  has  been  recognised  by 
the  system.  Currently,  this  link  is  largely  a  disny.  However,  soma  of 
the  teres  that  the  user  has  eada  uas  of  on  previous  occasions  are  loaded 
into  a  pushdown  Hat  for  use  by  the  ieker  link.  This  link  was  formed  to 
anticipate  possible  current  awareness  procedure*  which  could  be  added  at 
e  later  date. 

In  addition  to  including  terns  in  the  pushdown  Hat-  the  Found  link 
types  the  following  massage  to  the  user: 

ITS  KICK  TO  HAVE  100  BASK  AQtfK  MB. _ . 

WHAT  DO  ICO  WANT  THIS  TOO? 

The  IdLetln  link  is  than  called  to  replace  this  link. 

C.  Lister:  link 

In  order  to  hold  s  dialogue  with  the  user  in  his  natural  language, 
it  is  necessary  to  be  able  to  understand  the  user's  response*  in  some 
meaningful  way.  This  requires  that  soma  analytic  procedure  be  employed. 

Several  approaches  are  available  for  this  purpose.  These  consider*/: 


for  GRINS  were  •jutictic  analysers,  statistical  techniouee,  mad  word  look¬ 

up  procedures* 

Tha  ayn tactic  approach  was  raj acted  because  of  tb«  complexity  (if  act 
the  impossibility)  of  tha  taak  of  designing  an  analyser  that  la  a— 11 
anough  to  fit  tha  arailabla  ooaputer  and  at  the  a ana  tins  rapid  enough  to 
analyse  user  responses  within  a  faw  seconds*  Further more,  there  waa  little 
guaranty  that  tha  near  will  in  fact  be  formally  gri—tleal  in  hi*  con¬ 
versational  Idiom,  It  waa  not  eon aid  trad  desirable  to  impose  each  con- 
•trainta  on  a  uaar  whan  wt  with  to  make  bin  at  case. 

A  simple  won!  lookup  procedure  of  latching  term  sterna  against  words 

in  tha  uaar  response  would  be  inadequate  In  the  present  application,  be- 

cause  many  term*  used  in  tha  0  I  S  index  have  oowaon  stew  and/or  are 

actually  phraaas,  for  example: 

information 

information  seeking 

information  scisooee 

lha  Canter  for  tha  Information  Soieooaa 

These  are  four  separata  index  tense  used  in  the  0  19  system,  Also, 

there  ora  mery  variations  poeelble  for  soma  terms  such  set 

Association  *er  Computing  Machinery 
Aaen.  for  Coeput,  Kaeh, 

A.  C.  M. 

AON 

ACM 

In  addition  aoaa  terms  may  Appear  with  inverted  orders: 

informatics  MWdag 
seeking  for  information 

Any  attenpt  to  include  so  many  variations  In  a  list  would  be  e»- 
paielve  in  both  filo  apace  and  In  tint  required  to  lookup  eaoh  term. .  A 
lookup  'atop  list'  esalmded  A>r  many  of  these  ease  reaeons. 
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A  statistical  procedure  mmm  oonaddered  in  which  ibs  rsiahivs  fre¬ 
quency  of  alphabetlo  monogram#  appearing  in  lndsx  terms  divided  by  tbo 
rslativs  frequency  of  these  same  terns  In  ths  general  Bngllsh  language 
was  used  as  a  basis  for  separating  index  tores  fra  nen-isdss  toras* 

This  procedure  proved  to  b«  quit*  rapid  and  conservative  of  aenory  space 
and  was  able  to  achieve  a  69 %  ■operation  of  tha  terns.  This,  however, 
was  not  operationally  satisfactory  (A  ).  The  use  of  digrams  or  tri grass 
would,  perhaps,  rales  the  degree  of  s spars ti on  to  a  high  enough  level  but 
■any  of  the  problems  of  the  staple  lookup  procedure  would  still  prevail* 

The  eaaproalss  solution  which  has  been  adopted  is  a  Modified  lcjkup 
procedure  which  Is  oapabls  of  aatohlug  characters  in  speoiflsd  cjmblna- 
tions  either  within  a  single  user  response  word  or  in  a  sequence  of  words. 
The  heart  of  this  lookup  procedure  is  a  fils  of  referent  items 
(Figure  5)  which  correspond  to  index  terns  used  in  the  CIS  systes. 

These  referent  items  consist  of  key  alphabetic  characters  of  the  index 
terns  arranged  in  order,  and,  where  the  characters  are  not  consecutive, 
an  appropriate  'operator'  is  placed  between  than.  For  example,  A*KAXA# 
is  the  referent  item  for  AutoMATA. 

Any  word  that  starts  with  the  character  "A"  and  whioh  1*  later  fol¬ 
lowed  fay  the  character  sequenos  "MATA"  before  a"  space  is  reached  will  be 
Interpreted  ss  "AUTOMATA". 

likewise,  LAT.Cli,  «Uoh  is  the  referent  Item  for  "LATent  CUss 
analysis",  will  interpret  any  eonseeutlve  pair  of  user  words  that  start 
with  the  characters  "UT"  ard  "CL"  respectively  as  "LATBIT  CUSS  ANALYSIS". 

Another  operator  occurs  in  the  example,  U9*G<xaB0t  in  which  any 
sequence  of  words  of  whioh  the  first  word  starts  with  tbs  oharaeters 
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"LIB"  rrd  it  lnnedlstely  followed  by  •OCHOA*  la  the  mm  word  or  1*  fol¬ 
lowed  within  three  werd»  tar  ft  word  starting  with  1#  resngilaed  as 

being  "the  LIBrery  of  OOtOBees*. 

As  s  further  example  of  ths  uss  of  this  operator,  ell  of  the  follow- 

inf  will  be  detected  by  A«C«Mf  i 

Aosoolstion  for  Cmgxrtlng  KsohAneiy 
Assn,  for  Ccnpui.  Mach. 

/  .  0.  M. 

AON 

ACM 

The  final  operator  is  a  proxlnlty  operator  suoh  as  occurs  In  the 

referent  ltne,  XANG<AfiT,3DI,FtiM5#  whloh  first  tests  a  user  response 

word  for  ths  Initial  characters  «1ANQ*  and  than  scans  the  throe  previous 

and  the  three  following  user  words  for  the  Initial  character  sequences 

"ART"  then  "SW"  and  finally  If  any  of  those  are  deteoted,  the 

word  starting  with  "1ANG"  is  understood  to  nsan  "ABTiflolal  XANQuege", 

Any  of  the  following  would  be  so  deteoted  i 

FQataUy  derived  XANOuages 
ABTifloial  LANQuage 
a  LANQuage  that  is  SlNthetio 
a  LANQuage  that  la  fCWallaed 
a  SlNthetio  oonputer  generated  lANQuage 

Bach  user  word  la  tested  to  see  if  it  eatiafleo  any  of  the  referent 
itens  in  Its  alphabetic  subgroup,  i.a.  those  that  start  with  the  cane 
alphabetic  character. 

lech  tine  a  satisfactory  natch  is  aide,  ths  whir  of  ths  Index  tans 
concerned  is  added  to  a  hit  list,  By  the  and  of  the  analysis  of  a  given 
user  response  this  list  represents  ths  ooagmter's  lansdlste  interpretation 
of  what  the  user  said.  Ths  nwdbars  In  ths  hit  list  are  la  ths  order  that 
these  toms  were  deteoted.  The  hit  list  is  United  to  sixty-tee  itens  per 
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veer  response.  If  this  nueber  of  terms  is  exceeded  m  the  user  makes  hie 
response t  he  will  he  Interrupted  end  the  Listen  link  will  sell  Cheek  u 
though  the  ueer  hed  finished  hie  reply.  Xnoept  for  the  llnitatlans  of 
the  elee  of  the  hit  list,  the  ueer  nsy  use  ee  nary  line*  on  the  teletype 
peper  ee  he  wishes  to  neks  hie  response*  The  end  of  e  reeponee  le  lit- 
dleeted  by  *  blank  line. 

In  addition  to  the  actual  lookup  procedturea,  lleten  eleo  Include# 
the  neeeeeery  programing  for  accepting  the  user  input)  for  treating  word# 
that  ere  hyphenated  between  lime;  for  organising  words  In  preparation  for 
the  lookup  procedure;  for  detecting  the  end  of  a  response  end  for  detect¬ 
ing  a  special  character  which  is  used  to  Initiate  a  oall  to  the  Now  link 
for  the  aodlflestion  of  the  control  too  tor.  All  non-elphanuaerio  char¬ 
acters  except  for  the  hyphen  end  the  slash  are  treated  as  blank  spaces. 

The  id  stew  link  perform  its  operations  at  a  rata  of  roughly  two 
seconds  per  line  of  input.  In  order  to  facilitate  the  requirements  of 
the  proximity  operator,  Listen  lags  behind  the  ueer  by  one  to  two  lines 
in  its  analysis  of  his  input. 

The  list  of  referent  items  is  being  Improved  with  operational  ex¬ 
perience.  Lleten  makes  misinterpretation  error#  in  about  5 %  of  the  items 
added  to  the  hit  list.  This  error  rate  le  quite  tolerable.  Since  de¬ 
tected  tens  are  reed  beok  to  the  ueer  as  a  pert  of  the  conversation,  the 
ueer  has  an  opportunity  to  olsar  up  such  misunderstandings. 

The  original  referent  item  were  formed  from  0  I  S  index  terns  with 
the  following  rules  of  thumb  in  mlndt 

1.  Always  use  the  first  ehsreoter  of  the  index  term. 

2.  Avoid  the  use  of  Towels  ee  e  general  rule  as  they  tend 


to  haw*  low  inforastion  rslus  dus  to  th*ir  high  rot* 
of  ooourrsne*. 

3.  Avoid  the  us*  of  double  oensoneiita  (*  souros  of  ala* 
spellings). 

4.  flelsct  thess  consonants  In  *  tsrw  which  or*  s trussed 
In  the  prenunolatlon  of  ths  tor*. 

5.  Um  •  ths**uru*  to  ebook  referent  it***  for  an/  obrio»i* 
false  hit*  they  **/  ecuae. 

6.  Keep  itss*  u  short  as  posnibls  to  conssrvs  fils  specs. 

Dus  to  lnafflolsnoiss  of  ths  prograa  language  ussd  and  of  tbs  siss 

of  ths  naspu tor's  core  swsory,  sons  spools!  asosably  language  program 
wsr*  required  to  fit  th*  rsfsrsnt  list  into  mtaory.  To*  avsrag*  refer** 
sat  its*  has  sow  on  ohsraotsro  (ineluding  ths  operator*).  An  arsr&gs  of 
four  ocMputsr  words  is  rsquirsd  for  *aeh  rsfsrsnt  Its*. 

In  addition  to  rsfsrsnt  itsns  for  indsac  tsras,  there  srs  also 
ssvsral  rsfsrsnt  its**  for  use  in  detecting  afflrmiiws-negatire  typo 
responses.  Thsso  special  rsfsrsnt.  e  carry  negative  'tom1  makers  and 
hmos  ours  sesiiy  osparsbls  fro*  ths  regular  Old  index  tsra  maker*. 
Ths  makenu  for  ths  spsoinl  rsfsrsnt*  rang*  in  wain*  fro*  «*1,("1ES")» 
to  -5,  ("W)  -  Thu*  GRUB  1*  oapabl*  of  dotsndning  ths  dsgrss  of 
negativity  of  a  wasp’s  rsspooss. 

Ths  hit  list  also  contains  ths  maker  of  hits,  spsoial 

rsfsrsnt  itsas,  and  th*  total  maker  of  word*  Ustsd  in  th*  ussr's  re- 
■poms.  Dtoall/  about  twsnt/  p*resnt  of  th*  total  user  word*  ar*  ds- 
t*otod  a*  lefsrsnt  its**.  A  now  fait  list  is  sstabllsbsd  for  saofa  wsr 
rsspooss. 

IBmo  ths  analysis  of  th*  «**r'*  n*pooH  is  eeagOstsd  th*  Cheek 
link  1*  oallsd. 
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D.  Oh  •ok  Link 

Thia  link  oomrerte  th«  detected  India  term,  if  any,  froai  th«  hit 
list  aaiMblad  by  Listen  to  a  factor  of  torn  weight# .  Thia  motor,  the 
raaponaa  vac  tor,  hat  ona  element  par  lndax  tern  and  la  arranged  in  tan 
tnraber  order  ao  that  tha  value  of  tha  n^**  elanent  always  oomeponds  to 
the  might  aeaignad  to  tha  0th  tarn. 

Kaoh  lndax  tana  appearing  in  the  raaponaa  11  at  la  added  to  a  puah- 
down  liet  of  taraa  If  it  doea  not  already  appear  in  the  liat.  Thia  liat 
la  used  by  Aakar  a a  a  aouroa  of  ten*  to  inoludo  at  insertion  polnte  in 
amtanees  to  be  need  ae  feedbaok  to  tbo  uaer*  For  exaapla,  if,  at  ica* 
point  in  a  negotiation,  the  pushdown  liet  eontaine  the  nuabers  the  fol¬ 
lowing  tame  in  the  following  order i 

indexing 

doouaeota 

autoantle 

and  the  near  reapoade  with: 

I  WANT  DOmNO  WITH  TITUS  AMD  ABSBUCT8 
the  liat  will  be  lengthened  by  the  underlined  tenaa  whioh  are  deteoted 
by  lie  ten.  (Indagjnt  is  already  in  the  liet  and  tharefore  will  not  be 
added  to  it  again.) t 

abetraote 

tltlee 

indexing 

doounente 

autoaetlo 

The  08III9  reply  night  bet 

WHT  DO  YOU  WANT  AB3THACT8,  TITUKS  AND  XNDBQMO? 

The  puebdoen  liet  would  be  reduced  tot 

doounente 

autcnatlo 
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The  pushdown  list  is  United  in  slss  to  *ixty-two  toms.  When  this 
limit  is  reached  ths  list  Is  truncated  with  th*  old*r  half  of  th®  list 
being  destroyed. 

Th*  weights  assigned  to  ths  elesents  of  th*  response  vector  sr*  ob¬ 
tained  by  taking  th*  squar*  root  of  their  frequency  of  oceurrsws*  in  th* 
user  reeponse.  When  »  ten  hss  not  been  used,  th*  weight  of  its  Cor¬ 
responding  elenent  will  equal  tsro,  Thus,  for  th*  first  Mention  of  e 
tens  in  th*  user  response,  It  gets  s  weight  of  1,0.  With  eeoh  succeed¬ 
ing  usage  the  tens  receives  a  successively  mailer  additional  weight  in~ 
ormvt. 

If  the  hit  list  did  not  contain  any  index  term  numbers  but  did  con¬ 
tain  one  or  sore  nsgatlve-afflraatlve  reapoosse,  ths  average  nuaber  of 
such  responses  is  calculated.  Tbs  Check  link  thus  detersdnee  th*  quality 
of  the  user  response.  There  are  four  such  qualities  possible t 

1.  No  usable  terns  detected  (the  hit  lilt  is  enpty). 

2.  There  were  no  index  terne  detected  end  the  average 
of  the  apeelal  referents  is  negative. 

3.  There  were  no  index  terns  detected  end  th*  avenge 
of  the  special  referents  le  affirm  tire. 

4.  At  lsaet  on*  index  tern  was  detected. 

Th*  Oheck  link  usee  th*  current  conversation  nod*  and  th*  quality  of  the 
response  obtained  fron  the  user  to  detendne  which  link  to  cell  next. 

This  dtolslon  s  into  tore  is  given  in  Figure  6. 
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Figure  6.  Decision  Struotur*  for  the  Next  Link  After  the  Check  Link 


X.  Asoeat  Link 

The  Aspect  link  serve*  to  Integrate  the  response  vector  eeteblishei 
by  Check  with  a  search  sepeif lection  vector.  The  search  specification 
organisation  is  Identical  with  that  of  the  response  vector.  The  specifica¬ 
tion  represents  c  napping  of  the  user's  expressed  need  with  respect  to  the 
coordinates  of  the  CIS  document  collection. 

The  weights  of  the  response  vector  ere  first  normalised  to  a  maxi¬ 
mum  value  of  1.0  by  dividing  each  weight  by  the  highest  weight  In  the 
veotor. 

The  response  vector  is  than  added  to  the  seeroh  specification  veotor. 
This  veotor  sum  is  again  normalised  to  a  maximum  value  of  1.0. 

The  difference  between  the  previous  end  current  search  specifications 
is  calculated  byi 
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difference 
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where i  a  it  the  nuabtr  of  index  coordinates  in  tht  vtetor 

w  it  the  nuaber  of  ilaunti  with  *  value  graatar  then  s«ro 
3^  it  tn  elaamt  of  tht  previous  tpteifloation 
8]^  it  an  alaMot  of  tht  ourrwt  specif ication . 

Ibi#  difference  it  interpreted  at  the  decree  of  ehanga,  or  at  tht 
dittaaoa  that  tht  user's  expression  of  hit  nttd  hat  thifttd  at  a  ratult 
of  hit  latest  rttpentt.  Zt  it  charaottrittio  of  thli  Measure  that  It 
generally  dtertattt  toward  an  asywptote  with  taeh  succeeding  in  tar  action 
at  tht  user's  definition  of  hit  nttd  ttabiliiM  (Figure  7) .  If,  however, 
tht  uttr  leapt  to  a  different  subject  art*  tht  Mature  will  inortaa*  in 
value*  Tht  aaysptotio  level  that  the  diffarenc#  Mature  ttndt  toward  re¬ 
flect*  tht  degree  of  generality  of  the  utar't  exprttttd  nttd*  It  it  a 
Maturt  of  tht  tilt  of  tht  neighborhood  of  tht  utar't  lnttrttt* 

Tht  rate  of  ohangt  of  this  diffarenc •  Maturt  thus  rtfltott  tht 
stability  of  the  uttr'a  expression  of  hit  nttd  (figure  8).  When  tht 
avtragt  ratt  of  ohangt  rtaehtt  a  Minissss  threshold  value  further  negotia- 
tion  at  this  (oonvtraaticnal)  level  proud ses  little  in  the  way  of  better 
definition  of  the  uttr't  need*  Rente,  at  thla  point  another  strategy, 
the  actual  search  in  thla  eafit,  will  b*  adopted. 

Tht  rete  of  ohtngt  It  ocaputed  at  the  difference  between  two, 
two-point  wing  averages  of  the  difference  between  the  old  and  naw 
ttareh  specification  vectors. 

If  the  user's  expression  of  hit  nttd  hat  stabilised,  the  Starch 
link  will  be  '  lied,  otherwise  the  negotiation  will  be  continued  by 
oalllng  tht  Asker  link* 
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F*  Ifey, 

Th*  Atkar  link  mtvm  to  praamt  f**dbaok  to  tha  uasr,  Thar*  or*  a 
hundred  baale  eantane**  which  or*  divided  into  t*n  **ta  of  ton  **ch,  u 
shewn  in  Pigar*  9=  Isoh  **t  of  imUnoM  i*  d**lan*d  for  a  aaparat*  nod* 
of  eonvaractlon,  k  d**crlptlon  of  th*  tan  aod**  appear*  in  Figur*  10, 

Xany  of  th*  b*alo  santsneas  nay  bar*  up  to  thr**  word*  or  phraa** 
inserted  in  that  vim  th^  ar*  pracoctad  to  th*  u#*r.  For  axaapl*,  on* 
■uoh  baaie  *«nt*ae*  1st 

HOW  IS  /  HAUTE)  TO  /? 

Th*  *la*h**  ar*  th*  indue  tan*  or  phraa*  insertion  point*,  for  ueanpl*. 

If  th*  nu*b*rs  for  th*  t*raa  Recognition  and  Psychology  appear  at  th* 
top  of  th*  puahdom  Hat  and  the  above  a«nt«no*  war*  **l*ot*d  it  would  b* 
typed  out  a*  follow* < 

HOW  IS  BBSOCMXTIOM  RELATE)  TO  PSTCHOLOOT? 

Th*  ln**rt*d  word*  or  noun  phraao*  ar*  obtained  Tram  the  top  of  a  push¬ 
down  Hat  of  tern  nanb*r*  which  ar*  identified  with  previous  r**pcns*a 
that  th*  us*r  ha*  gLrm  and  which  oorr**pood  to  tho**  which  th*  Li*t«n 
link  ha*  recognised  an  0  I  S  index  tare*.  Thia  procedure  permit#  in 
•omees  of  900  Million  unique  sentences  or  question*  to  otinulat*  the 
uaar  to  d**orlb«  hi*  inf  creation  need. 

Initially  th*  pushdam  list  will  be  «epty  *o  that  non*  of  th*  In- 
eertebl*  smt«ree*  will  b*  utilised  until  ruoh  tin*  a*  th*  pushdown  list 
contain*  aaffiolmt  t*rna  to  fill  th*  ««si*ooe.  km  each  tarn  is  us  ad  it 
1*  removed  tram  th*  puahdowi  list,  Vo  twa  nay  appear  twic*  at  on*  tin* 
in  th*  pnafadow  list. 


M00«  t 

WHAT  DO  TOW  WANT 
COULD  YOU  CLARIFY  THAT 

TMATS  NOT  CLEAR  TO  HE.  PLEASE  REPHRASE  ST. 

PLEASE  CONTINUE 

NOW,  tell  me  AGAIN  WHAT  YOU  ARE  LOOKING  PON. 

I  Mm  UNDERSTAND  WHAT  YOU  HAVE  SAID*  PLEASE  HEPfAT, 

I  DOST  UNDERSTAND*  PLEASE  BAY  IT  NONE  CLEARLY. 

TELL  ME  NONE. 

AT  THIS  POINT  WHAT  VO1#  A«i  SAVINS  IS  UNCLEAR  TO  XE.  SUM  UP. 
WHAT  ELSE 

MODE  1 

PM  AT  IS  /-  RELATED  TO 

i  see.  v&u  want  something  deal  ins  with  /,  am  i  misht 

CAN  YOU  S«V  NONE  ABOUT  / 

WHAT  ASour  / 

WHY  IS  /  1MTENESTIN0  TO  YOU 
010  YOU  MEAN  TO  SAY  /  WHY 
PfaEASE  AMPLIFY  ON  /. 

I  UNDERSTAND  THE  -/-#  WHAT  ELSE 
TeLL  ME  HONE  ABOUT  /. 

WOULD  /  BE  AN  APPROPRIATE  INTERPRETATION  OP  WHAT  YOU  WANT 
MODE  3 

0< .  I  HAVE  /  AND  /,  WHAT  ELSE 
HDM  IS  /  RELATED  TO  / 

WHAT  IS  THE  RELATION  INTWEtN  t  AND  / 

MOW  ARE  /  AND  /  CONNECTED 
HOW  ARE  /  AND  /  ASSOCIATED 
00  YOU  MEAN  /OR  / 

WHAT  DOES  /  HAVE  TO  01  WITH  / 

YOU  WANT  /  WITH  /.  RIIMT 

COULO  YOU  EXPANO  ON  THE  RELATION  BETWEEN  /  AND  / 

IS  IT  CORRECT  PON  ME  TO  ASSOCIATE  /  WITH  / 

MODE  4 

*M ICM  OF  the  FOLLOWING  MEETS  YOu«  NfiEO  better-  /«  /  OH  / 

YOU  APPEAH  TO  WANT  S04ETHINO  AROUND  /#  /,  AND  /.  RIOHT 
HAY  WHAT  YOU  WANT  BE  DESCRIBED  AS  /.  /  ON  / 

WOULO  YOU  BELIEVE  /  ON  / 

HY  UNDERSTAND  I  NO  IS  THAT  YOU  WANT  /  WITH  /  AND  /,  RIOHT 
DO  /.  /  ANO  /  TEND  TO  DESCRIBE  WHAT  YOU  BANT 
YOU  WANT  /  ANO  /  WITH  /.  AH  !  RIOHT 
WHY  01 D  YOU  INDICATE  / 

WHAT  IS  THE  CONNECTION  BETWEEN  /  ANO  / 

GIVEN  a  CHOICE  BETWEE4  /.  /  ANO  /.  WHICH  00  YOU  PREFER 

MODE  S 

IS  /  MORE  APPROPRIATE  THAN  / 

WHAT  DO  YOU  WANT  /  FOR 
WHY  /  AND  / 

I  Can  not  SEE  what  /  has  to  do  with  /,  please  EXPLAIN. 
what  4)0  YOU  NEED  /  FOR 
WHY  on  YOU  WANT  /.  /  ANO  / 

IN  WHAT  CONTEXTUAL  AREA  ARE  YOU  QOINO  TO  APPLY  /  AND  / 

WHAT  ARE  YOU  QOINO  TO  UfE  -/-  AND  -/•  FDR. 

WHERE  DO  .YOU  WISH  TO  APPLY  -/«  ANO  -/• 

FCR  WHAT  APPLICATION  DO  YOU  WANT  •/«#  •/•  ANO  */- 

FiguxMi  9.  BasIo  A»ker  Rsipona«t 
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HO nb  6 

AMS  YOU  PUTTING  MS  ON 

00  you  SeA4.LV  THINK  TWA?  TW*T  IS  »*  KY  COILSCTION 


MMAT  ELSE  00  VOU  WANT 

MMA7  ELSE  OU  VOU  WANT  RESIDES  / 

I  KNOW  THIS  TAMES  TIME  .  ELRASE  BE  PATIENT  AND  TRY  AOA|N. 

1 M  NOT  ALL  that  SMART.  DIVE  IT  TO  ME  again, 
please  rephrase  tour  problem, 

CREEP  UP  THINGS  COULOlT  BE  AU  THAT  DAD,  ...  OR  ARE  THEY 
ARE  YOU  CUMfUStD  OR  Pi  IT  MR 

At.L  THAT  YOU  HAVE  SA Vi  DOISrT  HaKS  SENSE  SO  TRY  AGAIN, 


MODE  7 
OA  SO  FAR 
ARE  THERE  OK 
ARE  THESE  HHAT  YOU  HA  IT 
00  THE  AfeOVE  SEEM  TO  COVER  HHAT  YOU  HANT 
00  YHESE  FIT  YOUR  NEED 
ARE  THESE  OK 
HfcW  ARE  HE  DOING 
00  THESE  SEEM  TO  BE  A  IEOUATr 
ARE  ME  ON  THE  RIGHT  TRACK 
OK  THUS  FAR 


MODE  0 

00  YOU  WANT  MORE  DOCUMENTS 

HANT  MORE 

MORE  DOCUMENTS 

NORE  OF  THE  SANE 

00  YOU  WISH  ANY  MORE 

HON  ABOUT  SOME  more  documents 

shall  1  CONTINUE  GIVHQ  YOU  THERE 

HANT  SOME  MORE 

HOULO  YOU  LIKE  ANOTHER  BATCH 
00  YOU  WANT  SOME  HORE 


MODE  V 

00  VOU  WISH  TO  TELL  Mj  MORE 
WELL  THEN,  SMALL  ME  T*LK  MORE 
SHALL  WE  CONTINUE  OUR  DISCUSSION 
HOULO  YOU  LIKE  TO  MODIFY  VtHlH  REQUEST 


shall  we  continue  talking  „  „„ 

0*  THEN  WOULD  YOU  CARE  TO  HhPMRaSE  YOUR  REOUeET 

Then  would  you  like  tj  say  more 

Then  WOULD  YOU  like  to  OIVE  me  a  further  idea 

WHY  OONT  HE  DISCUSS  THIS  SOrE  MORS"  OK 
PERHAPS  YOU  WOULD  LIKE  TO  »A*  SOMETHING  ELSE 


mode  lo 

ARE  YOU  TRYING  TO  TELL  ME  SOMETHING 

ATS  YOU  RESTATING  YOU  I  PROBLEM 

CAN  YOU  DIRECT  ME  WITH  RESPECT  TO  THE  ABOVE 


WHERE  SHALL  ME  GO  FRO  I  MSHfc 

YOU  CANT  ANSWER  WITH  >  SIMPLE  rgS  OR  HO,  CAN  YOU 

IM  NOT  SUH6  THAT  I  UNDERSTOOD  YOU  BEFORE.  PLEASE  SAY  AGAIN. 

HE  PATIENT,  NOW,  PLEA1E  REWRITE  THAT,  IT  RAY  HEL*  WE, 

PlEaSE  OOHT  RUSH  ME,  .  ,  ,  NOW  TELL  MB  AGAIN. 

This  CONFUSES  ME.  PLEASE  TRY  TO  CLEAR  MB  UP, 

YOU  ARE  NUT  GETTING  AOCGOS*  TO  HE  VERY  NELL  BUT  KEEP  GOING. 


Figura  9  (ContM. )  Basic  Kikar  Rasponsaa 


Cycle  4,5,6,4,5»6,et« 
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Tern 

Puahdow 

List 

Ned*  alio 


1  Mpi j  Qenoral  oonteoct  fr*e  r**pcn »•  (i.*.  mJ o 

ln**rt«)  to  generate  *  point  of  departure 


\ 

OuB  tsTs  rsBpCKSS 

To  gasarato  ralat«d 
two  ten  reopen* a  L  tar**  -  to  pro-rid* 
f  additional  Hrw 
•ion*  of  r«f«r«no* 

Throe  ten  reopen** 


B*« pens*  to  probe  "WHT?"  for  background 
a**ooiation§  md  to  nek*  uier  think 


Mood  breaking  r— poo**  -  to  get  omit  to 
relax,  r*fl«ot,  think  wxr*  broadly,  oto. 


Hod*  Condition*  8— pon— 


7  After  *  "Du*p"  "D00UNWT3  OK?" 


8  After  Afflmatlr*  tDBS  DOCWDOW" 
reepco**  to  7 
(no  tern  detected) 


9  After  Negative  "MOBS  TALK?" 

r**pan*«  to 
Kodee  1-8 
(no  ten  detected) 


30  Tern  detected  after  "TOUR  AJtSWR  18  LARfBR  SIAM  MX  CJJI8TT0*- 
Xodee  7-9  ARS  TDU  RX8TATDI0  TOUR  OnsnOV?" 


figure  30.  Aatar  le*ppcn  Node* 
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The  pusbdotm  list  is  structured  on  s  first-in-laat-out  basis  so  that 
the  Most  recently  identified  taras  ax's  used  first,  thus  kssping  ths  oon- 
▼srsation  as  up  to  data  as  consistent  with  a  productive  oormrsation, 

Ths  pushdown  list  functions  in  a  similar  manner  to  one  desorlbsd  for  the 
ELIZA  cysts*  at  KIT  (  5)  * 

Tha  Mods  of  ths  ssntanos  to  b#  presented  to  the  user  is  determined 
by  Askar  on  tha  basis  of  tha  typs  of  (a)  response  last  obtained  from  ths 
user,  (b)  whether  that  response  followed  a  listing  of  documents,  (c)  the 
else  of  the  pushdown  list  and  (d)  the  previous  Mode.  Ths  detailed 
deolalon  structure  for  Mods  selection  is  given  in  figure  11. 

Ouoe  a  new  Mods  has  been  selected,  one  of  the  ten  sentences  for  the 
Mode  la  s also ted  at  randan  (via  a  random  number  generator)  and  is  pre¬ 
sented  to  the  user  together  with  the  appropriate  terms  corresponding  to 
nusbsrs  obtained  from  the  top  of  the  pushdown  list. 

O,  Search  Link 

Tha  aaaroh  la  Implemented  by  forming  a  "document  array"  which  is 
effectively  an  array  with  an  slement  for  each  docummst  In  ths  0  I  S 
collection.  Actually,  ths  document  array  is  broken  into  segments  of 
704  documents  each,  because  of  the  limited  else  of  core  Memory,  lack 
ssgseat  is  assembled  individually  and  stored  on  disc.  Presently,  four 
mieh  segments  are  required  but  the  mafcer  asy  easily  be  expanded  by 
modifying  the  control  veotor  accordingly. 

The  Inverted  fils  entry  is  obtain  ad  from  disc  for  each  tarn  whose 
element  In  tha  search  specification  veotor  has  a  weight  above  the  mini- 
awe  threshold  value.  The  weight  assigned  to  the  term  1s  modified  to  re¬ 
flect  its  information  theoretical  value  with  rsepeet  to  the  0  I  S 
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oolleotlon  and  than  added  algebraically  to  the  elements  of  the  docunent 
array  that  correspond  to  domawnts  Indexed  toy  the  tern.  In  this  Banner 
weights  are  accumulated  for  eaoh  dooument  In  the  collection  In  proportion 
to  the  extent  that  they  correspond  to  the  eearoh  specification  vector. 

The  aixty-ihree  doeuemte  with  the  nigheei  weight*  ere  then  »•*■&*£ 
into  a  document  output  liet  in  rank  order  of  their  accumulated  weight*. 
This  la  accomplished  by  mesne  of  a  string  proesssor,  A  typical  distri¬ 
bution  of  theca  weights  Is  given  in  Figure  12. 

The  eearoh  specification  vector  is  than  set  to  sero  in  preparation 
for  any  later  renegotiation. 

The  ordered  document  output  list  of  the  sixty- three  best  docxamnt* 
is  then  stored  for  accees  by  the  Pump  link.  The  doeuasnt  search  is  then 
oomplete. 

The  Dump  link  is  then  called. 

H.  Pu»>  Unk 

The  Dump  link  ia  first  called  by  the  Search  link  in  order  to  print 
out  the  rank-order,  document  number,  accumulated  document  weight,  author, 
title,  bibliographic  Information  and  location  of  the  highest  four  docu¬ 
ments  on  the  document  output  lilt  created  by  the  Search  link,  which  the 
user  has  not  yet  had  presented  to  him  during  this  enoounter  with  GfOJS. 

In  the  oass  where  a  searoh  la  made  on  the  renegotiation  of  a  question, 
a  new  search  will  oft«n  result  in  soot*  documents  that  the  user  has  already 
had  presented  to  him.  In  this  ease  only  the  rank-order,  docusueit  number, 
and  document  weight  together  with  a  "SHE  ABOVE"  message  are  presented  In 
order  to  save  time. 

When  the  Pump  link  is  called  the  second  or  subsequent  tine  after  a 
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■  March,  four  Bore  doouacnto  in  obtained  froa  succeeding  positions  of  the 
output  list  and  art  presented  to  tho  user  in  tha  uai  Banner, 

In  tha  oaaa  where  tha  output  Hat  of  doouaente  la  exhaueted,  tha  uaar 
la  ao  info  rued  aid  GRINS  rararta  back  to  tha  conversation  aedee  for  further 
negotiation, 

Tha  Askar  link  la  called  after  four  additional  new  doeuaents  hare  bean 
Hated  (In  addition  to  an y  nuaber  of  "SEE  ABOVE"  entries).  The  user  la 
first  aekad  (node  7)  if  tha  doeuamts  appear  to  be  what  the  user  wants  and 
then,  if  ao,  does  tha  user  wish  sore  (node  a).  If  not,  the  user  Is  in¬ 
cited  to  renegotiate  tha  question  (node  9).  If  the  user  declines  this  in¬ 
vitation,  tha  Taradn  link  la  called*  The  foregoing  sequences  arc  il¬ 
lustrated  in  blook  diagram  fora  in  Figure  13  and  in  the  staple  copy  of  a 
negotiation  in  tha  Appendix. 

*•  Tamln  Link 

This  link  aarrea  to  teralnats  or  suspend  interaction  with  the  current 
uaar  and  to  initiate  oontaot  with  another  user  or  to  end  tha  pragma. 

Tha  current  user  is  asked  if  his  naae  should  ba  saved.  If  tha  an  ewer 
is  yea,  tha  user's  naae  and  up  to  fifteen  tera  nuaber*  froa  the  pushdown 
list  are  stored  in  an  appropriate  section  of  the  user  file  on  disc. 

The  user  ie  than  asked  If  there  is  anyone  else  who  withes  to  use  the 
eystea.  If  there  is,  GRINS  says  to  put  hla  on,  says  good-by  to  the  pre¬ 
sent  user,  and  rewinds  him  to  log  his  call.  Then  the  Tnit  is  called. 

If  no  acre  users  art  waiting,  tha  Tewrin  link  copies  tha  uaar  fils 
froa  disc  and  a  control  vsotor  froa  oore  aaaory  to  aajpietio  tape.  All 
tapes  are  rewound  ml  GRINS  la  terainated. 


Fl*nr*  13.  amplified  Diocraa  of  locctlatloc  Ooquonoo 
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J.  Maw  Ijlnk 

this  link  is  not  used  in  tho  normal  operation  of  GRINS.  Its  purpoe# 
it  to  of  for  a  naans  of  observing  and  nrd:  fring  elements  of  the  control 
vector. 

This  vector  consists  of  twenty-slat:  elements  stored  at  the  top  of  the 
ooaaun  area  of  core  memory,  Those  elements  contain  thresholds,  a  random 
number  generator  starter ,  array  sixes,  and  the  like.  The  entire  control 
vector  is  the  only  array  that  '—ft—  intact  throughout  all  the  links  of 
dBms  and  hence  is  often  used  to  store  arguments  from  one  link  to  another* 

The  Now  link  asks  the  experimenter  which  control  element  he  desires 
to  see.  Upon  being  specified,  the  value  of  the  element  ie  printed  in 
decimal  integer,  octal  integer,  and  alphabetic  formats. 

The  experimenter  then  le  given  the  opportunity  to  modify  this  element, 
see  another  element  or  to  call  in  another  link. 

<kie  of  the  control  element#  contains  tbs  usual  link  that  follows  Mow. 
The  experimenter  may  elect  to  go  to  this  link  or  he  aay  deal  piste  any 
other  link* 

GaMS  wiU  thm  oontlnae  from  whatever  Unit  is  selected. 
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IT.  Evaluation  and  Commit* 

CBEDIS  has  not  had  sufficient  us*  on  ths  basis  of  which  to  make  on 
exhaustive  analysis.  However,  the  structure  a*  described  in  Chapter  III 
has  certain  features  that  %  rrant  coament. 

Any  analysis  of  GRINS  effectiveness  must  take  its  dynamic  behavior 
into  aoeount,  The  differ  ^  a  between  a  ccmaand  type  retrieval  eye  ten  euah 
as  those  examined  in  the  anfisld  project  (6)  and  GRINS  la  like  the  dif¬ 
ference  between  a  bailie 'do  and  a  guided  Biss  lie.  In  the  first  case  a 
rather  intense  amount  of  effort  eust  be  concentrated  into  aiming  the 
missile  before  the  shoot,  while  In  the  second  ease  laaa  intense  but 
adequate  inflight  corrections  may  be  made  to  insure  a  hit* 

GBDiS  meets  the  criteria  spool fied  in  Chapter  XI.  A  user  can  satis¬ 
factorily  negotiate  e  document  search  in  bis  conversational  idiom  with  a 
minimum  of  Instruction  or  format  restriction*  The  resulting  searches  ap¬ 
pear  to  be  appropriate  to  the  requests* 

F!rom  the  user's  point  of  view  GRINS  is  fir  more  eenvenimit  than  any 
of  the  existing  CIS  retrieval  procedures*  Because  of  the  time  required 
to  negotiate  the  user's  question  and  the  type  of  search  procedure  em¬ 
ployed  in  GBXN3,  the  program  is  slower  than  the  CIS  'Boolean'  uisc 
search  program  which  starts  to  list  documents  almost  immediately  after 
a  search  command  la  made. 

The  rank-ordered  output  of  QB3NS  is  generally  preferable  to  the 
accession-numher-ordered  listing  obtained  by  present  methods  because  the 
user  has  more  flexibility  in  determining  the  else  of  the  listing  he  has 
requested.  tllthln  whatever  else  listing  the  near  does  get,  the  licting 
gives  Mm  those  documents  first  which  are  determined  to  be  most  appropriate. 
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The  0FXN9  MWtili  snkee  discriminations  amnng  documents  obtained  in  * 
••arch  viisreat  the  'Boolean'  search  doee  not. 

Using  the  present  r*r*ior  of  G8ZNS  it  is  not  possible  to  sake  s 
search  m  the  basis  of  the  date  of  publication  or  author  names.  In  ths 
future  a  special  referent  oould  be  structured  to  detect  a  date  In  the 
user's  respc  ^se  v7r  looking  for  a  four  character  “word"  starting  with 
19??,  Wher  rush  a  word  is  detected  its  prorLaity  way  be  acannsd  for 
such  terns  ss  "before*  or  "since" .  If  such  temporal  Modifiers  are  de¬ 
tected  a  special  search  subroutine  could  be  utilised  to  Unit  the  search 
accordingly 

The  prcolem  of  searching  on  the  basis  of  an  author's  nans  is 
essentially  a  problem  of  datemining  that  such  a  request  is  being  aade 
by  tho  user.  Since  it  ie  undesirable  to  sake  the  user  oonfora  to  a 
restrictive  forest,  special  procedures  would  be  necessary  to  detect  foras 
such  as  "written  by  "  and  the  like. 

Both  the  prims  author's  last  name  and  the  date  of  publication  are 
format  controlled  and  hence  searchable  in  the  0  I  S  collection. 

T^e  listen  link  in  its  current  form  cannot  deteat  a  negative  re¬ 
quest  such  as  occurs  in  the  user  smitanoe: 

I  WANT  SOUTHING  ON  AUTOMATA  BUT  NOT  COMPUTERS, 

This  stands  as  a  major  weatoiees  in  the  ability  of  the  present  system 
to  undertake  a  meaningful  dialogue.  This  will  be  particularly  true  where 
the  Listen  link  makes  s  false  "hit".  When  such  a  false  hit  is  fed  back 
to  the  user,  he,  the  user,  should  be  abla  to  mke  a  direct,  negative, 
correction  rather  then  1st  the  tera  in  error  diminish  by  attrition  over 
succeeding  interactions. 


this  capability  should  be  attainable  through  a  redesign  of  Lie ten, 
there  are  many  ways  of  negating  an  idea,  or  the  symbol  (term)  that  denote* 
it,  in  the  natural  conversational  idiom.  These  means  will  have  to  be  ex¬ 
amined  to  see  if  oertaln  word  patterns  charaoterlstieally  occur  in  them. 

If  such  word  patterns  can  be  found  and  if  they  dependably  denote  a  re¬ 
jection  of  terse  which  fall  consistently  in  the  seme  syntactic  locations v 
than  a  means  to  detect  such  patterns  may  be  incorporated  into  Listen. 

If  the  negative  request  can  be  identified,  the  remainder  of  the 
system  oan  adequately  handle  negative  weights  in  the  response  end  search 
specification  vectors  as  well  ss  in  the  donu—nt  array. 

Sines  the  current  analysis  of  tha  user's  response  la  not  too  sophis¬ 
ticated  it  is  possible  for  an  inquirer  experienced  In  the  system  to  adopt 
a  sort  of  teletype  shorthand  which  is  compatible  with  the  referent  items. 
Kanos,  for  those  with  experience,  the  effort  required  to  communicate  with 
GBH5  may  be  reduced. 

CBEOHS  (or  any  other  system)  will  only  function  as  well  as  the  quality 
of  Indexing  of  the  collection  to  which  it  is  applied  permits.  Tbs  CIS 
collection  is  currently  manually  indexed  by  graduate  students  and  suffers 
by  all  that  Is  implied  by  nanual  indexing.  Different  indexers  will  index 
the  same  document  differently  and  the  same  indexer  will  index  the  seme 
domamnt  differently  at  different  times.  As  an  example  of  this,  one  docu¬ 
ment  waa  discovered  to  be  mistakenly  lnoluded  in  the  C  I  S  collection 
twice.  The  document  was  indexed  twice  by  the  asms  person  within  a  fsw 
weeks,  each  tins  sight  index  terms  were  used.  Of  these  sight  terms  only 
four  were  used  twice  (and  thasa  four  appeared  in  the  title  of  the  dooument). 
It  is  felt  that  many  terms  are  negleeted  because  tha  indexer  just  does  not 
happen  to  oonslder  them. 
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Until  such  *  Hjm  thet  eooeonioal  and  reliable  font  of  eutonatle 
Indexing  la  adopted,  tha  eye ten  will  require  Manual  indexing. 

The  Llatan  link,  with  or  without  an  added  associativity  feature,  can 
be  used  as  an  eld  to  annual  Indexing*  The  procedure  here  would  require 
thet  new  doounant  tltlee  be  flret  introduced  into  the  eeriel  file  without 
Indexing,  than  the  Listen  link  (or  e  Modified  version  of  it)  would  be  used 
to  seen  the  tltlee  of  these  new  documents. 

All  terns  in  the  tltlee  that  correspond  to  index  terns  would  be  listed 
for  the  Indexer's  consideration.  If  associativity  la  used,  then  associated 
terns  can  also  bs  presented  to  the  indexer.  The  Indexer  then  nay  choose 
anong  these  terns  and  add  more  as  hs  sses  fit. 

likewise,  when  new  terms  are  added  to  the  Inverted  file,  the  socle  ting 
docunent  listings  nay  be  scanned  fey  Listen  in  order  to  locate  old  docu¬ 
ments  thet  Might  be  additionally  indexed  by  the  new  tern. 

An  associativity  technique  has  bean  designed,  although  aa  yet  it  has 
not  been  lnplemented.  With  this  technique  additional  tame  ere  added  to 
those  detected  in  the  user  response. 

The  weights  of  the  additional  tame  ere  oomputed  on  the  basis  of  the 
weight  assigned  to  the  user's  tern  in  tha  response  vector  and  on  tha  pro¬ 
portion  of  tinea  that  tha  aasoolated  tans  co-occurs  with  the  user's  term: 

A.  *  R.  X  lil 
1  i  7± 

where:  %  is  the  weight  of  the  i^1  almunt  of  the  response  veotor 

Tij  is  the  frequency  of  oo-oceurrencs  of  terns  i  end  J 

/ 

Ti  is  the  frequency  of  occurrence  of  term  i 

Aj  is  the  weight  assigned  to  associated  term  J 


u 


Soughl j  five  NO«di  tf*  required  to  form  eaoh  file  mtrjr.  Hwo, 

It  would  be  advantageous  to  areata  and  Mintila  a  pro  ncapulert  ill*  of 
aseoo lationa, 

la  aotual  praotiee  on  associativity  file  will  bo  stored  on  disc  with 
*  record  for  each  ton.  Tha  number#  of  tho  Moot  highly  associated  term* 
•nd  thair  roopoetiro  associativity  fad  tor*  will  bo  stored  In  this  record, 

Tho  Additional  time  estimated  for  tho  assooiativlty,  using  pre- 
oomputad  associations  will  bo  on  tho  order  of  0.2  oseonds  por  tom.  Tho 
tins  required  for  a  search  will  Inc reass  by  a  faetor  of  four  duo  to  tho 
additional  taraa  generated  unloss  higher  search  thresholds  are  used. 

As  was  amntioned  previously,  GRINS  has  boon  applied  to  a  collection 
of  twenty-six  hundred  doounaats.  Tho  tine  required  to  search  the  col- 
leetion  is  lnoreased  toy  about  four  additional  aooonds  per  additional  ten 
with  a  weight  abort  the  threshold  us  ad  In  tho  search  specification  duo  to 
the  fast  that  eaoh  tarn  record  Met  be  obtained  once  for  eaoh  segmmt  of 
the  dominant  array.  The  use  of  a  higher  threshold  will,  therefore,  shorten 
the  eearoh  tine.  It  aoy  be  useful  in  this  respect  to  derelop  an  algorithm 
to  ocmpite  an  optimal  threshold  on  the  basis  of  the  distribution  of  weights 
in  the  search  specifications.  Sines  the  eearoh  specification  is  normal- 
laed  nab  an  adjustable  threshold  may  net  be  worthwhile. 

Tbs  eearoh  speed  may  obviously  be  increased  toy  the  use  of  a  more 
rapid  computer  Installation,  toy  more  efficient  i***g«— — aid  moat  dra— 
aatioally  by  an  lnoreased  else  of  core  memory.  If  a  16K  core  memory  were 
available  for  the  sad. sting  program  for  ample,  eaoh  e agent  oould  be  in- 
oreaaod  to  handle  over  forty-eight  hundred  dooumente  and  the  eearoh  rate 
would  be  increased  toy  a  faetor  of  six  or  eight. 
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An  Additional  alternative,  which  nay  pww  necessary  for  very  large 
collections  (in  excess  of  a  hundred  thousand  docunente)  would  bo  to  In¬ 
troduce  on  intermediate  level  of  isarohlng  between  the  conversation  and 
the  actual  search  levels.  This  intermediate  level  Right  be  structured  as 
a  pseud o-documn t  level  in  which  statistically  derived  document  clusters 
are  attained  prior  to  tha  real  search  of  the  documents,  in  order  to  search 
only  those  documents  that  appear  in  tha  more  fruitful  clusters. 

The  current  version  of  GBXN3  is  expansive  to  operate.  A  typical 
negotiation  requires  twenty  or  sure  sdxmtss  at  a  current  computer  time 
charge  of  #50  per  hour.  About  eighty  par  cant  of  this  time  la  taken  by 
the  user  in  making  his  responses. 

Any  new  system  must  prove  its  economic  worth  if  it  is  to  be  accepted 
as  a  real  working  tool.  In  this  cense  an  Interface  system  such  as  GHINS 
must  be  eoonoadoally  acceptable  to  both  tha  individual  user  (whose  eco¬ 
nomics  oonoern  time,  effort,  or  expense)  and  to  the  administrator  who  must 
show  someone  that  his  money  is  Doing  well  spent* 

The  GBZK3  structure  is  only  justified  where  a  sufficient¬ 

ly  largo  dommmnt  collection,  user  population,  and  time-sharing  computer 
facility  are  available. 

Assuming  that  an  eeonoaieally  satisfactory  environment  Is  established 
for  GKXNS,  the  structure  may  be  extended  to  include  a  current  awareness 
or  S.D.Z.  capability  for  the  known  user  population.  A  procedure  for  de¬ 
termining  a  user's  Interest  with  respect  to  the  scope  of  the  oolleetion 
ohould  be  simple  to  devise.  9uoh  a  capability  oould  be  added  as  an  ex¬ 
tension  of  the  Found  link. 


JS 

Ao oandlx 

Two  actual  encounters  with  GR1N3  art  demonstrated  hare.  Th*  first 
waa  c  endue  tad  by  the  author,  th*  **oond  by  a  graduate  student  In  th* 
Butin***  College  »t  Lehigh*  Thia  student's  name  has  been  ohanged  h*r*  to 
"Smith*  in  order  to  presere  hi*  anonymity, 

Th*  lino*  which  start  with  a  question  sark  Contain  u»*r  responses. 
All  th*  remaining  line*  are  genera  tad  by  QBZM3. 

Tha  user  file  uaad  for  this  demonstration  we*  new  ao  that  neither 
the  name  "Gbroen"  nor  the  name  "Smith"  were  familiar  to  the  aye  tan. 

Initially,  after  determining  Qraen's  name,  OSINS  load*  file*  from 
aa&trtic  tap*  (HB~4f  created  on  Sept.  6,  1967)  to  th*  dl*o  unit. 

Following  this,  GEMS  attempt*  to  locate  Qraen's  nan*  in  it*  files. 
Since  the  naan  isn't  there,  QBDiS  ohecks  to  see  If  it  should  be  by  asking, 
"HAVB  MB  MBT  BEFORE?"  If  Qreen  had  snswered  "TBS"  to  the  query,  th* 

•7* ten  would  ask  for  his  naan  again  and  reoheok  the  files. 

At  this  point  the  actual  negotiation  starts.  Notice  that,  as  the 
negotiation  develops,  more  and  more  information  is  obtained  by  GRINS. 

By  the  fifth  interaction  the  user  Is  largely  repeating  himself.  HI* 
definition  of  hi*  n**d  ha*  stabilised  and  so  a  search  of  the  CIS 
dowept  collection  is  mad*. 

From  th*  best  four  document*  obtained  in  this  search,  it  appears  that 
th*  system  has  mlaint*rpret«d  Green's  use  of  the  word  negotiation  (which 
i*  translated  directly  into  the  Index  term  conference  by  the  system) ,  In 
the  CIS  collection  th*  term  conference  1*  used  to  refer  to  mean  a  mast¬ 
ing  of  a  professional  group  rather  than  a  mediation.  The  seeoed,  third 
and  fourth  document*  listed  ere  Inappropriate  to  Green's  needs  a*  a  result 
of  thl*  error. 
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drew  renegotiated  hi*  upon  determining  the  misinterpreta¬ 

tions  eade  by  th*  »jit»,  The  result  of  this  ssoond  negotiation  Is  shews 
on  the  succeeding  page. 

Although  Orewa  was  satisfied  with  the  new  search,  he  did  not  request 
additional  documents  and  he  did  not  wish  to  renegotiate  his  need  eo  his 
interaction  with  GRINS  was  terminated. 

Since  an  additional  user  was  Indicated  before  Grew  left  G8INS,  the 
STStew  reinitialised  itself  in  older  to  greet  hi*.  This  tins,  since  the 
files  are  already  stored  In  their  proper  plaoe,  the  eye tea  proceeds 
directly  to  Identify  the  new  user,  Smith. 

It  Is  emphasised  that  Ssith's  interests  do  not  overlap  the  oon tents 
of  the  CIS  oolleotion  very  oaoh.  His  example  is  used  here  as  a  sort  of 
•worst  oass*  to  show  that  GRINS  oan  work  sven  with  a  novice  who  wants 
somsthlng  that  is  not  represented  in  the  docuaent  oolleotioo. 

The  only  instructions  glvsn  to  Smith  wore  to  repeat  grossly  mis¬ 
spelled  words,  to  hyphenate  words  when  necessary  at  the  mod  of  a  line, 
hcer  to  end  a  lino,  how  to  sod  a  response,  end  to  wait  at  the  start  of 
each  line  until  the  question  mark  is  printed. 

The  difficulty  that  a  novice  can  have  is  evident  from  the  extensive 
wistypings  that  appear  in  Smith's  responses.  The  structure  of  GRINS  is 
such  that  such  errors  can  be  tolerated. 

Hitta  exception  of  the  first  rtnorent,  all  of  the  documents  re- 
trlwed  and  prssanted  to  Hr.  Smith  ere  indexed  by  the  ten  business.  The 
second  document  was  also  Indexed  by  system.  The  first  document  retrieved 
for  Smith  represents  an  error  caused  by  the  detection  of  ACM  In  hla  lest 
response  before  the  searohi 

M>.  LSI  It*  TKT  AGAIN.  GAN  ICO  TSLL  Kg  . . . 
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ft*  ions  ACM  is  sumttly  u*«dt  only  ana*  in  ths  ijrtta,  hones,  its 
lnfonation  salu*  is  —.arts*! ,  and  in  this  oupli,  suffieiani  to  put  this 
doeusunt  at  ths  top  of  ths  list.  This  srror  sxsnpllfls*  ths  nssd  for  rsry 
ssrsful  design  of  rsfsrant  list  item. 

In  this  OTaspIs  inf  amotion  that  is  not  rsprssantsd  in  ths  0  18 
eollsetion  is  requested.  In  this  sas«  asm  prsoants  ths  slosest  doit 
sent*  ayallthlsi 


art*  *A  at 

HELLO.  THIS  it  AMIMS. 

what  is  yOur  »*«f 

tj  s  Of WM 

t 

pleas e  wait  a  rr.w  minutes  for  he  to  *het  weaoy. 

MEMORY  LOAD*D  FROM  SEP  AA  AT  TAPE  l*-A 
YJUM  .NAME  IS  All  FAMILIAR  TO  MU  MM*  OMCtM. 
have  re  net  wr.ro  ret 
»N3 
» 

what  do  you  want  mm.  fiar.ENi 

Tl  wdlLft  LIKE  SOME  INFORMATION  A40UT  MAN  MACHINE  INTERACTION 
7 

no  ran  wvt  machine  on  man-machimet 

7  1  Mr  AM  .MACHINES  THAT  INTERFACE  WITH  MUM.  I  AM  CONCERNED  WITH 
TIME  MKA3TIATIOM  OF  1 1  SAM  RUESTIONS  MY  REFERENCE  LIWRAHI ANS  AND 
T SIMULATIONS  or  THIS  PROCEDURE  47  COMPUTERS 
T 

A3  COMPUTER,  SIMULATION  ANTI  LIRRARY  TEND  TO  DESCRUE  WHAT 
YOU  RANT? 

rrrs.  rut  I  am  concerned  with  the i a  effects  on  the  user  or  them. 

T 

WHY  01  Y3*l  NAMT  EFFICIENCY.  REFERENCE  AND  HUESTI0N5T 
•Y3U  ASSUME  THE  FORMER.  RUT  701)  ARE  CORRECT.  I  AM  BUILD  INrt  A 
f DEVICE  which  I  MORE  MILL  RE  ABLE  TO  SIMULATE  THE  NEROTI tATION 
TRM3CE3S  MET KEEN  USERS  AMD  INFORMATION  SREC I AL I  STS* 

T 

PLEASE  IFPMRASE  YOUR  PROWLER* 

TfilWE  AF  references  TO  WORK  DONE  IN  THE  AREA  OF  RUESTIOM  NEfiOTIA- 
TTIOM  PROCEDURE  S.  rtO'INEN  TAT  ION  AND  OR  SIMULA T I  JN  OF  THESE  AMO 
T  RELATED  MATERIALS 
T 


A  WAICM  IS  NOw  RFInI,  made  ON  THE  CIS  OOCUME.NT  COLLECTION  TO 
LOCATE  DOCUMENTS  THAT  REST  Elf  YOUR  NEED. 


THE  DOCUMENT!  CLIrEST  TO  YOUR  REQUEST  ARE) 

I  CIS  DOC  NO.  I  AAA.  WT.*  N.S4I 

HIFRER.C.  AH  AMALYSl  a  JE  OUCSTIONS  AND  ANSWERS  IN  LIRRARlES 

LERI  UR  <MIV  CENTER  FOR  THE  INEORNATION  SCIENCES. JUNE  | f A* , AF - AFOSrt- 
734-aa.  OE  CMP  S-RSA.  STUDIES  IN  TME  MAM-SYSTEM  INTERFACE  IN  LI4RAM1E 
S.  REP.  | 

<F ILE ) 

*.  CIS  DOC  NO.  1  4»R.  WT.*  7. AM 
AMERICAN  PSYCH  ASSN.  RHOJ  ON  SCI  INFO  EXCHANGE  IN  PSYCH 

AMEN  PSYCHOL  ASS.  PR))  ON  SCIFN  INFOiM  EACH  IN  PSYCHOL.  4  VOLS. 

Aim  i«a3 
TFILM 

3  CIS  lETC  NO.  I  I  I  A.  J  T  *  ■  A. SI* 

4AUN.  H.  DOCUMENTATION  OF  TECH.  AND  SCIENT.  MEETINGS 
AIM  DOC  INST.  ANNUAL  NEE  TINA.  |«*4»  PROC. .  I.  R43-EAA 
<♦30*0 

4  CIS  DOC  NO.  III*.  WT*  *  R.SI4 

GRIFFITH.  4.  HARVEY.  W.  EFFECT  OF  CONVENTION  PRESENTATION  ON  INFO 
EXCHANGE  BEHAVIOR  AND  MS 

ANEW  DOC  INST.  ANNUAL  MEETING.  1**4.  PROC..  I.  RRI-RI3 
JBOOKI 

now  are  we  ooinat 

TNOT  AS  WELL  AS  1  HAD  HOPED.  I  AH  MORE  INTERESTED  IN  THE  NAN 
T MACHINE  INTERFACE  AT  THE  MOMENT 


Flfor*  14.  {ana  ■•«oti*ticc» 


can  you  otftixT  nr.  with  newer  T9  the  arovct 
m  m  tryin*  to  oo  just  that,  do  vow  nave  materials*  pccuhcmti 

**nu  so  pa*?«  asou;  rue  ns.cxmiixriex  or  va  ham  machine  imts  ?»*«*♦ 
» 

00  DOCUMENT.  NAN-NACMINE  AND  MATERIALS  TEND  TO  DCSCRIRC 
WHAT  VOtl  WANT! 
t»M 
? 

t  CM  HOT  see  WHAT  AUTOHAT  I  ON  HAS  TO  DO  WITH  GUEST  IONS. 

H.TAM  EKPLAIN. 

T  i  AM  THVIS5  TO  ASK  $U?-ST10«$  AM5  TO  SET  AHSWCHS  VIA  CaHKlTttl 
T 

I  KNOW  THIS  TAKES  HHr  .  PLEASE  H  PATIENT  AMO  TAT  AGAIN. 

TOK.  GIVE  Hf.  WHAT  TOU  HAVE  ON  ANSWERING  IHrOANAT  ION  GUI  ACS  BY 
7NP.AMS  OF  An  ON  LINK  COMPUTER  SYSTEM 
7 

TOtl  WANT  SYSTEMS  WITH  ON-LINE.  RIGHT? 

TNOT  OtltTft.  I  WANT  ON  LINT  DOCUMENT  RETRIEVAL  SYSTEM*. 

» 

A  SEARCH  IS  NOW  SEIMR  MADF.  ON  THE  CIS  DOCUMENT  COLLECTION  TO 
LOCATE  fWCUNENTS  THAT  BEST  FIT  YOU  A  NEED. 


THE  nOCINFNTS  CLOSEST  TO  YOU*  REVUE ST  AM  l 
I  CIS  noc  NO.  tits.  WT. »  A. 791 

UCKLIDE*.  J.  MAN-COMPUTER  INTERACTION  IN  INFORMATION  SYSTEMS 

in  n.  hiiainopf.  r.n.t  toward  a  national  information  system,  second  a 

nn  NATL  COLL  ON  INPOAM  RETR.  APRIL  ISAS.  SPARTAN  ROOKS.  43-TS 
<000-0 

■>  CIS  IMC  NO.  THAI.  WT»»  A.7AS 

IVtf.E.  STARCH  PROCEDURES  GASP!)  ON  MRASURRS  OP  RELATEDNESS  BETWEEN 

DOCUMENTS 

I  •  T.PNOJP.CT  NAC.OIMP.  1 94A.HAC*  TR-S9*  THESIS* .NONA-  4IGR*  A|.  PH.0 
THESIS 
(PILE) 

3  CIS  OOC  NO.  RA4A.  WT.-  R.4A3 
EDVARDS.  0.  OCAS-ON-LINE  CRYPTAMALYT I C  AIO  SYSTEM 
MIT.  PROJECT  MAC.  NAC-TR-RT.  N0NA-41AH-AI  MAY.  194* 

(TILE! 

A  CIS  OOC  NO.  1794.  WT *•  A.AAJ 

nPNNIS.  J.  DLASER.  E.  THE  STRUCTURE.  OP  ON-LINE  INFORM  AT  ION  PROCESSING 
SYSTEMS 

C3NMESS  JN  THE  INPOAM  SYSTEM  SCIEM.  «N0  PAJC*  WASHING TON.  SPARTAN. 

3*14 

(-TOOK) 

ARE  THESE  WHAT  YOU  WAMTT 

TY»S 

7 

SHALL  I  CONTINUE  M VINA  YOU  THESE? 

7 NO  THANK YOH 
7 

PERHAPS  YOU  WOULD  like  to  sat  something  else? 

7 NOT  MOW 
7 

SMALL  I  RPNEMAP.R  YOlIH  NAIF.  MR.  0RP.EN7 
7  YES 
7 

USE*  ANYONE  ELSE  WISH  TO  TALK  WITH  ME? 

7  YES 
7 

PUT  HIM  ON  THEM.  THANK  YOU  AMO  SOOOSY  NR.  ORCCM. 

PLEASE  LOA  YOUR  CALL 
I 


Fl*«r#  14  (Ooot'd.) 


non 


FT 


sr.p  «4  *7 

li'LLO,  TM'.S  !  *  n-i**-.. 

WHAT  IS  YOUR  NANF,T 
7CH  SHI1H 
7 

YOUR  NAME  IS  MOT  FAttlLlAP  TO  ME  MR.  SMITH. 

HAVE  we  MET  BEFORE? 

TMO 

7 

WH«r  00  YOU  » fit T  HS-  SMITH? 

7  1  am  CONCf.RMEO  WITH  THE  GENERAL  PROBLEM  OF  ECONOMIC  FORECASTING. 
?  SPECIE l CALLY#  I  WISH  TO  DEVELOP  A  EO  RECASTING  SYSTEH  WHICH  WILLC 
TWILL  BE  MORE  ACCURATE  THAN  PRESENT  ECONOMETRIC  SYSTEMS* 

? 

COULD  YOU  EXPAND  ON  THE  RELATION  BETWEEN  SYSTEMS  AMD  ECONOMICS? 

TIT  IS  POSaIRLF  TO  LOOK  6S  AN  ECONOMY  AS  A  KIND  OP  ORGANIC  OR 
7BI0L0GICAL  SYSTEM.  NOW.  15  IT  POSSIBLE  TO  USE  MATTEMAT I  CAL 
THAT HEM AT  I  CAL  SYSTMES  SYSTEMS  TO  FORECAST  ECONOMIC*  SPECID 
T SPECIFICALLY  BUSINESS*  CONDITIONS. 

7 

YOU  WANT  BUSINESS  AND  ECONOMICS  WITH  MATHEMATICS.  AM  I  RIGHT? 

7  WELL < • < •  NOT  EXACTLY.  1  WANT  TO  USE  MATHEMATICS  TO  FORECAST 

7 future  business  or  economic  conditions. 

7 

I  CAN  NOT  SEE  WHAT  0U3INCSS  HAS  TO  DO  WITH  USE.  PLEASE  EXPLAIN. 
TSUSINFSS  HAS  NOTHING  TO  DO  WITH  USE*  RATHER  I  WISH  TO  USE 
T  THE  LANGRAG  LANGUAGE  OF  MATHEMATICS  TO  FORECS  FORECAST  BUSIN- 
TESS  FUTURE  BUSINESS  CONDITIONS  SUCH  AS  THOSE  WHICH  EXIST  IN 
7 THE  HOUSING  MARKET. 

? 

CHEER  UP  THINGS  COULDNT  BE  ALL  THAT  BAS.  ...  OR  ARE  THEY 
7 NO .  LET  ME  TRY  AGAIN.  CAN  YOU  TELL  ME  ANYTHING  ABOUT 
TBUSINE55  FORECASTING. 

? 

A  SEARCH  IS  NOW  BEING  MADE  ON  THE  US  DOCUMENT  COLLECTION  TO 
LOCATE  DOCUMENTS  THAT  BEST  FIT  YOUR  NEED. 


THE  DOCUMENTS  CLOSEST  TO  YOUR  RE SUE ST  ARC  I 
I  CIS  DOC  NO.  |*«8.  WT < ■  B. 455 

RU8IN0FF.  H.  DESCRIPTION  OF  CATALOGING  ♦  INDEXING  SYST  FOR  THE  ACM 
REPOSITORY 

UNI V  OF  PENN*  MOORE  SCH  OF  ELEC  ENG*  AFOSR  43-B484*  AO  *12877*  JAN 

1945 

(FILE) 

8  cis  ooc  no.  isee*  wt.»  b.asi 

AUERBACH  CORP.  A  DESCRIPTION  OF  AUERBACH  INFORMATION  MANAGEMENT  SYSTEM 
AUERBACH  CORP,  PHILADELPHIA*  PA»  FEB  1*4* 

(FILE) 

3  CIS  DOC  NO.  2628*  WT.-  B.417 

GENTLE. E.C. JR.  DATA  COMMUNICATIONS  IN  BUSINESS 
NEW  YORK.  AMERICAN  TELEPHONE  AND  TELEGRAPH  CO. 

(BOOK) 

4  CIS  DOC  NO.  147*.  WT.-  8.417 
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IS.  abstract 


In  general,  problems  are  solvable  along  a  continuum  of  abstraction.  There 
is,  at  any  given  point  in  the  development  of  tl.e  solution,  a  most  efficient  or 
optimum  strategy. 

In  information  retrieval  systems  the  ultimate  solution  is  obtained  at  a 
more  specific  rather  than  at  a  more  abstract  level.  The  question  negotiation 
process  is  viewed  as  an  efficient  preliminary  strategy  which  enables  an  infor¬ 
mation  seeker  to  obtain  his  information  goal  with  the  least  amount  of  overall 
effort . 

In  order  for  a  problem  solution  procedure  to  remain  efficient  a  means  for 
predicting  when  to  change  strategies  must  be  provided.  In  the  particular  ex¬ 
ample  of  question  negotiation  this  prediction  is  based  on  the  rate  at  which 
the  definition  of  the  user’s  need  develops. 

An  on-line  computer  program  called  GRINS  is  described  which  implements  th« 
information  specialist’s  role  in  the  negotiating  of  a  user’s  need.  This  pro¬ 
gram  communicates  with  the  user  in  his  natural  conversational  idiom.  When  the 
negotiation  is  judged  by  GRINS  to  be  as  well  developed  as  it  is  likely  to  get, 
a  search  is  made  of  the  available  documents .  This  search  produces  an  ordered 
list  of  the  sixty-three  best  documents  which  come  closest  to  the  user's  ex¬ 
pressed  need. 

The  structure  of  the  program  is  modular  so  that  improvements  may  be  easilv 
'  '  ^  are  suggested. 
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